Health facility assessment of small and sick newborn care in low- and middle-income countries: systematic tool development and operationalisation with NEST360 and UNICEF.

BACKGROUND: Each year an estimated 2.3 million newborns die in the first 28 days of life. Most of these deaths are preventable, and high-quality neonatal care is fundamental for surviving and thriving. Service readiness is used to assess the capacity of hospitals to provide care, but current health facility assessment (HFA) tools do not fully evaluate inpatient small and sick newborn care (SSNC). METHODS: Health systems ingredients for SSNC were identified from international guidelines, notably World Health Organization (WHO), and other standards for SSNC. Existing global and national service readiness tools were identified and mapped against this ingredients list. A novel HFA tool was co-designed according to a priori considerations determined by policymakers from four African governments, including that the HFA be completed in one day and assess readiness across the health system. The tool was reviewed by > 150 global experts, and refined and operationalised in 64 hospitals in Kenya, Malawi, Nigeria, and Tanzania between September 2019 and March 2021. RESULTS: Eight hundred and sixty-six key health systems ingredients for service readiness for inpatient SSNC were identified and mapped against four global and eight national tools measuring SSNC service readiness. Tools revealed major content gaps particularly for devices and consumables, care guidelines, and facility infrastructure, with a mean of 13.2% (n = 866, range 2.2-34.4%) of ingredients included. Two tools covered 32.7% and 34.4% (n = 866) of ingredients and were used as inputs for the new HFA tool, which included ten modules organised by adapted WHO health system building blocks, including: infrastructure, pharmacy and laboratory, medical devices and supplies, biomedical technician workshop, human resources, information systems, leadership and governance, family-centred care, and infection prevention and control. This HFA tool can be conducted at a hospital by seven assessors in one day and has been used in 64 hospitals in Kenya, Malawi, Nigeria, and Tanzania. CONCLUSION: This HFA tool is available open-access to adapt for use to comprehensively measure service readiness for level-2 SSNC, including respiratory support. The resulting facility-level data enable comparable tracking for Every Newborn Action Plan coverage target four within and between countries, identifying facility and national-level health systems gaps for action.

Neonatal inpatient dataset for small and sick newborn care in low- and middle-income countries: systematic development and multi-country operationalisation with NEST360.

BACKGROUND: Every Newborn Action Plan (ENAP) coverage target 4 necessitates national scale-up of Level-2 Small and Sick Newborn Care (SSNC) (with Continuous Positive Airway Pressure (CPAP)) in 80% of districts by 2025. Routine neonatal inpatient data is important for improving quality of care, targeting equity gaps, and enabling data-driven decision-making at individual, district, and national-levels. Existing neonatal inpatient datasets vary in purpose, size, definitions, and collection processes. We describe the co-design and operationalisation of a core inpatient dataset for use to track outcomes and improve quality of care for small and sick newborns in high-mortality settings. METHODS: A three-step systematic framework was used to review, co-design, and operationalise this novel neonatal inpatient dataset in four countries (Malawi, Kenya, Tanzania, and Nigeria) implementing with the Newborn Essential Solutions and Technologies (NEST360) Alliance. Existing global and national datasets were identified, and variables were mapped according to categories. A priori considerations for variable inclusion were determined by clinicians and policymakers from the four African governments by facilitated group discussions. These included prioritising clinical care and newborn outcomes data, a parsimonious variable list, and electronic data entry. The tool was designed and refined by > 40 implementers and policymakers during a multi-stakeholder workshop and online interactions. RESULTS: Identified national and international datasets (n = 6) contained a median of 89 (IQR:61-154) variables, with many relating to research-specific initiatives. Maternal antenatal/intrapartum history was the largest variable category (21, 23.3%). The Neonatal Inpatient Dataset (NID) includes 60 core variables organised in six categories: (1) birth details/maternal history; (2) admission details/identifiers; (3) clinical complications/observations; (4) interventions/investigations; (5) discharge outcomes; and (6) diagnosis/cause-of-death. Categories were informed through the mapping process. The NID has been implemented at 69 neonatal units in four African countries and links to a facility-level quality improvement (QI) dashboard used in real-time by facility staff. CONCLUSION: The NEST360 NID is a novel, parsimonious tool for use in routine information systems to inform inpatient SSNC quality. Available on the NEST360/United Nations Children's Fund (UNICEF) Implementation Toolkit for SSNC, this adaptable tool enables facility and country-level comparisons to accelerate progress toward ENAP targets. Additional linked modules could include neonatal at-risk follow-up, retinopathy of prematurity, and Level-3 intensive care.

Correction: Postnatal infection surveillance by telephone in Dar es Salaam, Tanzania: An observational cohort study.

[This corrects the article DOI: 10.1371/journal.pone.0254131.].

Implementing a Care Pathway for small and nutritionally at-risk infants under six months of age: A multi-country stakeholder consultation.

Nutritional vulnerability under the age of 6 months is prevalent in low- and middle-income countries with 20.1% infants underweight, 21.3% wasted and 17.6% stunted in a recent review. A novel Care Pathway for improved management of small and nutritionally at-risk infants under 6 months and their mothers (MAMI) has recently been developed to provide outpatient care at large coverage. We aimed to investigate stakeholders' views on the feasibility of its implementation and to identify barriers and enablers. This was an early stage formative mixed-methods study: an online survey plus in-depth interviews with country-level stakeholders in nutrition and child health from different geographical regions and stakeholder groups. 189 stakeholders from 42 countries responded to the online survey and 14 remote interviews were conducted. Participants expressed an urgent need for improved detection and care for small and nutritionally at-risk infants under 6 months. Whilst they considered the MAMI Care Pathway feasible and relevant, they noted it was largely unknown in their country. The most mentioned implementation barriers were: community-specific needs and health care seeking barriers, health workers' lack of competence in breastfeeding counselling and the absence of a validated anthropometric screening method. Possible enablers for its implementation were: patients' preference for outpatient care, integrating the MAMI care pathway into existing maternal and child health programmes and the possibility of a local pilot project. Adaptation to the local context was considered crucial in further scale-up.

Classifying caesarean section to understand rising rates among Palestinian refugees: results from 290,047 electronic medical records across five settings.

BACKGROUND: Rising caesarean-section rates worldwide are driven by non-medically indicated caesarean-sections. A systematic review concluded that the ten-group classification system (Robson) is the most appropriate for assessing drivers of caesarean deliveries. Evidence on the drivers of caesarean-section rates from conflict-affected settings is scarce. This study examines caesareans-section rates among Palestinian refugees by seven-group classification, compares to WHO guidelines, and to rates in the host settings, and estimates the costs of high rates. METHODS: Electronic medical records of 290,047 Palestinian refugee women using UNRWA's (United Nations Relief and Works Agency for Palestine Refugees in the Near East) antenatal service from 2017-2020 in five settings (Jordan, Lebanon, Syria, West Bank, Gaza) were used. We modified Robson criteria to compare rates within each group with WHO guidelines. The host setting data were extracted from publicly available reports. Data on costs came from UNRWA's accounts. FINDINGS: Palestinian refugees in Gaza had the lowest caesarean-section rates (22%), followed by those residing in Jordan (28%), West Bank (30%), Lebanon (50%) and Syria (64%). The seven groups caesarean section classification showed women with previous caesarean-sections contributed the most to overall rates. Caesarean-section rates were substantially higher than the WHO guidelines, and excess caesarean-sections (2017-2020) were modelled to cost up to 6.8 million USD. We documented a steady increase in caesarean-section rates in all five settings for refugee and host communities; refugee rates paralleled or were below those in their host country. INTERPRETATION: Caesarean-section rates exceed recommended guidance within most groups. The high rates in the nulliparous groups will drive future increases as they become multiparous women with a previous caesarean-section and in turn, face high caesarean rates. Our analysis helps suggest targeted and tailored strategies to reduce caesarean-section rates in priority groups (among low-risk women) organized by those aimed at national governments, and UNRWA, and those aimed at health-care providers.

Measuring coverage and quality of supportive care for inpatient neonatal infections: EN-BIRTH multi-country validation study.

Background: An estimated 7 million episodes of severe newborn infections occur annually worldwide, with half a million newborn deaths, most occurring in low- and middle-income countries. Whilst injectable antibiotics are necessary to treat the infection, supportive care is also crucial in ending preventable mortality and morbidity. This study uses multi-country data to assess gaps in coverage, quality, and documentation of supportive care, considering implications for measurement. Methods: The EN-BIRTH study was conducted in five hospitals in Bangladesh, Nepal, and Tanzania (July 2017-July 2018). Newborns with an admission diagnosis of clinically-defined infection (sepsis, meningitis, and/or pneumonia) were included. Researchers extracted data from inpatient case notes and interviews with women (usually the mothers) as the primary family caretakers after discharge. The interviews were conducted using a structured survey questionnaire. We used descriptive statistics to report coverage of newborn supportive care components such as oxygen use, phototherapy, and appropriate feeding, and we assessed the validity of measurement through survey-reports using a random-effects model to generate pooled estimates. In this study, key supportive care components were assessment and correction of hypoxaemia, hyperbilirubinemia, and hypoglycaemia. Results: Among 1015 neonates who met the inclusion criteria, 89% had an admission clinical diagnosis of sepsis. Major gaps in documentation and care practices related to supportive care varied substantially across the participating hospitals. The pooled sensitivity was low for the survey-reported oxygen use (47%; 95% confidence interval (CI) = 30%-64%) and moderate for phototherapy (60%; 95% CI = 44%-75%). The pooled specificity was high for both the survey-reported oxygen use (85%; 95% CI = 80%-89%) and phototherapy (91%; 95% CI = 82%-97%). Conclusions: The women's reports during the exit survey consistently underestimated the coverage of supportive care components for managing infection. We have observed high variability in the inpatient documents across facilities. A standardised ward register for inpatient small and sick newborn care may capture selected supportive care data. However, tracking the detailed care will require standardised individual-level data sets linked to newborn case notes. We recommend investments in assessing the implementation aspects of a standardised inpatient register in resource-poor settings.

Distance to available services for newborns at facilities in Malawi: A secondary analysis of survey and health facility data.

BACKGROUND: Malawi has halved the neonatal mortality rate between 1990-2018, however, is not on track to achieve the Sustainable Development Goal 12 per 1,000 live births. Despite a high facility birth rate (91%), mother-newborn dyads may not remain in facilities long enough to receive recommended care and quality of care improvements are needed to reach global targets. Physical access and distance to health facilities remain barriers to quality postnatal care. METHODS: Using data We used individual data from the 2015-16 Malawi Demographic and Health Survey and facility data from the 2013-14 Malawi Service Provision Assessment, linking households to all health facilities within specified distances and travel times. We calculated service readiness scores for facilities to measure their capacity to provide birth/newborn care services. We fitted multi-level regression models to evaluate the association between the service readiness and appropriate newborn care (receiving at least five of six interventions). RESULTS: Households with recent births (n = 6010) linked to a median of two birth facilities within 5-10 km and one facility within a two-hour walk. The maximum service environment scores for linked facilities median was 77.5 for facilities within 5-10 km and 75.5 for facilities within a two-hour walk. While linking to one or more facilities within 5-10km or a two-hour walk was not associated with appropriate newborn care, higher levels of service readiness in nearby facilities was associated with an increased risk of appropriate newborn care. CONCLUSIONS: Women's choice of nearby facilities and quality facilities is limited. High quality newborn care is sub-optimal despite high coverage of facility birth and some newborn care interventions. While we did not find proximity to more facilities was associated with increased risk of appropriate care, high levels of service readiness was, showing facility birth and improved access to well-prepared facilities are important for improving newborn care.

Equity in newborn care, evidence from national surveys in low- and middle-income countries.

BACKGROUND: High coverage of care is essential to improving newborn survival; however, gaps exist in access to timely and appropriate newborn care between and within countries. In high mortality burden settings, health inequities due to social and economic factors may also impact on newborn outcomes. This study aimed to examine equity in co-coverage of newborn care interventions in low- and low middle-income countries in sub-Saharan Africa and South Asia. METHODS: We analysed secondary data from recent Demographic and Health Surveys in 16 countries. We created a co-coverage index of five newborn care interventions. We examined differences in coverage and co-coverage of newborn care interventions by country, place of birth, and wealth quintile. Using multilevel logistic regression, we examined the association between high co-coverage of newborn care (4 or 5 interventions) and social determinants of health. RESULTS: Coverage and co-coverage of newborn care showed large between- and within-country gaps for home and facility births, with important inequities based on individual, family, contextual, and structural factors. Wealth-based inequities were smaller amongst facility births compared to non-facility births. CONCLUSION: This analysis underlines the importance of facility birth for improved and more equitable newborn care. Shifting births to facilities, improving facility-based care, and community-based or pro-poor interventions are important to mitigate wealth-based inequities in newborn care, particularly in countries with large differences between the poorest and richest families and in countries with very low coverage of care.

Birthweight: EN-BIRTH multi-country validation study.

BACKGROUND: Accurate birthweight is critical to inform clinical care at the individual level and tracking progress towards national/global targets at the population level. Low birthweight (LBW) < 2500 g affects over 20.5 million newborns annually. However, data are lacking and may be affected by heaping. This paper evaluates birthweight measurement within the Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study. METHODS: The EN-BIRTH study took place in five hospitals in Bangladesh, Nepal and Tanzania (2017-2018). Clinical observers collected time-stamped data (gold standard) for weighing at birth. We compared accuracy for two data sources: routine hospital registers and women's report at exit interview survey. We calculated absolute differences and individual-level validation metrics. We analysed birthweight coverage and quality gaps including timing and heaping. Qualitative data explored barriers and enablers for routine register data recording. RESULTS: Among 23,471 observed births, 98.8% were weighed. Exit interview survey-reported weighing coverage was 94.3% (90.2-97.3%), sensitivity 95.0% (91.3-97.8%). Register-reported coverage was 96.6% (93.2-98.9%), sensitivity 97.1% (94.3-99%). Routine registers were complete (> 98% for four hospitals) and legible > 99.9%. Weighing of stillbirths varied by hospital, ranging from 12.5-89.0%. Observed LBW rate was 15.6%; survey-reported rate 14.3% (8.9-20.9%), sensitivity 82.9% (75.1-89.4%), specificity 96.1% (93.5-98.5%); register-recorded rate 14.9%, sensitivity 90.8% (85.9-94.8%), specificity 98.5% (98-99.0%). In surveys, "don't know" responses for birthweight measured were 4.7%, and 2.9% for knowing the actual weight. 95.9% of observed babies were weighed within 1 h of birth, only 14.7% with a digital scale. Weight heaping indices were around two-fold lower using digital scales compared to analogue. Observed heaping was almost 5% higher for births during the night than day. Survey-report further increased observed birthweight heaping, especially for LBW babies. Enablers to register birthweight measurement in qualitative interviews included digital scale availability and adequate staffing. CONCLUSIONS: Hospital registers captured birthweight and LBW prevalence more accurately than women's survey report. Even in large hospitals, digital scales were not always available and stillborn babies not always weighed. Birthweight data are being captured in hospitals and investment is required to further improve data quality, researching of data flow in routine systems and use of data at every level.

Stillbirths including intrapartum timing: EN-BIRTH multi-country validation study.

BACKGROUND: An estimated >2 million babies stillborn around the world each year lack visibility. Low- and middle-income countries carry 84% of the burden yet have the least data. Most births are now in facilities, hence routine register-recording presents an opportunity to improve counting of stillbirths, but research is limited, particularly regarding accuracy. This paper evaluates register-recorded measurement of hospital stillbirths, classification accuracy, and barriers and enablers to routine recording. METHODS: The EN-BIRTH mixed-methods, observational study took place in five hospitals in Bangladesh, Nepal and Tanzania (2017-2018). Clinical observers collected time-stamped data on perinatal care and birth outcomes as gold standard. To assess accuracy of routine register-recorded stillbirth rates, we compared birth outcomes recorded in labour ward registers to observation data. We calculated absolute rate differences and individual-level validation metrics (sensitivity, specificity, percent agreement). We assessed misclassification of stillbirths with neonatal deaths. To examine stillbirth appearance (fresh/macerated) as a proxy for timing of death, we compared appearance to observed timing of intrauterine death based on heart rate at admission. RESULTS: 23,072 births were observed including 550 stillbirths. Register-recorded completeness of birth outcomes was > 90%. The observed study stillbirth rate ranged from 3.8 (95%CI = 2.0,7.0) to 50.3 (95%CI = 43.6,58.0)/1000 total births and was under-estimated in routine registers by 1.1 to 7.3 /1000 total births (register: observed ratio 0.9-0.7). Specificity of register-recorded birth outcomes was > 99% and sensitivity varied between hospitals, ranging from 77.7-86.1%. Percent agreement between observer-assessed birth outcome and register-recorded birth outcome was very high across all hospitals and all modes of birth (> 98%). Fresh or macerated stillbirth appearance was a poor proxy for timing of stillbirth. While there were similar numbers of stillbirths misclassified as neonatal deaths (17/430) and neonatal deaths misclassified as stillbirths (21/36), neonatal deaths were proportionately more likely to be misclassified as stillbirths (58.3% vs 4.0%). Enablers to more accurate register-recording of birth outcome included supervision and data use. CONCLUSIONS: Our results show these routine registers accurately recorded stillbirths. Fresh/macerated appearance was a poor proxy for intrapartum stillbirths, hence more focus on measuring fetal heart rate is crucial to classification and importantly reduction in these preventable deaths.

Immediate newborn care and breastfeeding: EN-BIRTH multi-country validation study.

BACKGROUND: Immediate newborn care (INC) practices, notably early initiation of breastfeeding (EIBF), are fundamental for newborn health. However, coverage tracking currently relies on household survey data in many settings. "Every Newborn Birth Indicators Research Tracking in Hospitals" (EN-BIRTH) was an observational study validating selected maternal and newborn health indicators. This paper reports results for EIBF. METHODS: The EN-BIRTH study was conducted in five public hospitals in Bangladesh, Nepal, and Tanzania, from July 2017 to July 2018. Clinical observers collected tablet-based, time-stamped data on EIBF and INC practices (skin-to-skin within 1 h of birth, drying, and delayed cord clamping). To assess validity of EIBF measurement, we compared observation as gold standard to register records and women's exit-interview survey reports. Percent agreement was used to assess agreement between EIBF and INC practices. Kaplan Meier survival curves showed timing. Qualitative interviews were conducted to explore barriers/enablers to register recording. RESULTS: Coverage of EIBF among 7802 newborns observed for ≥1 h was low (10.9, 95% CI 3.8-21.0). Survey-reported (53.2, 95% CI 39.4-66.8) and register-recorded results (85.9, 95% CI 58.1-99.6) overestimated coverage compared to observed levels across all hospitals. Registers did not capture other INC practices apart from breastfeeding. Agreement of EIBF with other INC practices was high for skin-to-skin (69.5-93.9%) at four sites, but fair/poor for delayed cord-clamping (47.3-73.5%) and drying (7.3-29.0%). EIBF and skin-to-skin were the most delayed and EIBF rarely happened after caesarean section (0.5-3.6%). Qualitative findings suggested that focusing on accuracy, as well as completeness, contributes to higher quality with register reporting. CONCLUSIONS: Our study highlights the importance of tracking EIBF despite measurement challenges and found low coverage levels, particularly after caesarean births. Both survey-reported and register-recorded data over-estimated coverage. EIBF had a strong agreement with skin-to-skin but is not a simple tracer for other INC indicators. Other INC practices are challenging to measure in surveys, not included in registers, and are likely to require special studies or audits. Continued focus on EIBF is crucial to inform efforts to improve provider practices and increase coverage. Investment and innovation are required to improve measurement.

Antibiotic use for inpatient newborn care with suspected infection: EN-BIRTH multi-country validation study.

BACKGROUND: An estimated 30 million neonates require inpatient care annually, many with life-threatening infections. Appropriate antibiotic management is crucial, yet there is no routine measurement of coverage. The Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study aimed to validate maternal and newborn indicators to inform measurement of coverage and quality of care. This paper reports validation of reported antibiotic coverage by exit survey of mothers for hospitalized newborns with clinically-defined infections, including sepsis, meningitis, and pneumonia. METHODS: EN-BIRTH study was conducted in five hospitals in Bangladesh, Nepal, and Tanzania (July 2017-July 2018). Neonates were included based on case definitions to focus on term/near-term, clinically-defined infection syndromes (sepsis, meningitis, and pneumonia), excluding major congenital abnormalities. Clinical management was abstracted from hospital inpatient case notes (verification) which was considered as the gold standard against which to validate accuracy of women's report. Exit surveys were conducted using questions similar to The Demographic and Health Surveys (DHS) approach for coverage of childhood pneumonia treatment. We compared survey-report to case note verified, pooled across the five sites using random effects meta-analysis. RESULTS: A total of 1015 inpatient neonates admitted in the five hospitals met inclusion criteria with clinically-defined infection syndromes. According to case note verification, 96.7% received an injectable antibiotic, although only 14.5% of them received the recommended course of at least 7 days. Among women surveyed (n = 910), 98.8% (95% CI: 97.8-99.5%) correctly reported their baby was admitted to a neonatal ward. Only 47.1% (30.1-64.5%) reported their baby's diagnosis in terms of sepsis, meningitis, or pneumonia. Around three-quarters of women reported their baby received an injection whilst in hospital, but 12.3% reported the correct antibiotic name. Only 10.6% of the babies had a blood culture and less than 1% had a lumbar puncture. CONCLUSIONS: Women's report during exit survey consistently underestimated the denominator (reporting the baby had an infection), and even more so the numerator (reporting known injectable antibiotics). Admission to the neonatal ward was accurately reported and may have potential as a contact point indicator for use in household surveys, similar to institutional births. Strengthening capacity and use of laboratory diagnostics including blood culture are essential to promote appropriate use of antibiotics. To track quality of neonatal infection management, we recommend using inpatient records to measure specifics, requiring more research on standardised inpatient records.

Chlorhexidine for facility-based umbilical cord care: EN-BIRTH multi-country validation study.

BACKGROUND: Umbilical cord hygiene prevents sepsis, a leading cause of neonatal mortality. The World Health Organization recommends 7.1% chlorhexidine digluconate (CHX) application to the umbilicus after home birth in high mortality contexts. In Bangladesh and Nepal, national policies recommend CHX use for all facility births. Population-based household surveys include optional questions on CHX use, but indicator validation studies are lacking. The Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) was an observational study assessing measurement validity for maternal and newborn indicators. This paper reports results regarding CHX. METHODS: The EN-BIRTH study (July 2017-July 2018) included three public hospitals in Bangladesh and Nepal where CHX cord application is routine. Clinical-observers collected tablet-based, time-stamped data regarding cord care during admission to labour and delivery wards as the gold standard to assess accuracy of women's report at exit survey, and of routine-register data. We calculated validity ratios and individual-level validation metrics; analysed coverage, quality and measurement gaps. We conducted qualitative interviews to assess barriers and enablers to routine register-recording. RESULTS: Umbilical cord care was observed for 12,379 live births. Observer-assessed CHX coverage was very high at 89.3-99.4% in all 3 hospitals, although slightly lower after caesarean births in Azimpur (86.8%), Bangladesh. Exit survey-reported coverage (0.4-45.9%) underestimated the observed coverage with substantial "don't know" responses (55.5-79.4%). Survey-reported validity ratios were all poor (0.01 to 0.38). Register-recorded coverage in the specific column in Bangladesh was underestimated by 0.2% in Kushtia but overestimated by 9.0% in Azimpur. Register-recorded validity ratios were good (0.9 to 1.1) in Bangladesh, and poor (0.8) in Nepal. The non-specific register column in Pokhara, Nepal substantially underestimated coverage (20.7%). CONCLUSIONS: Exit survey-report highly underestimated observed CHX coverage in all three hospitals. Routine register-recorded coverage was closer to observer-assessed coverage than survey reports in all hospitals, including for caesarean births, and was more accurately captured in hospitals with a specific register column. Inclusion of CHX cord care into registers, and tallied into health management information system platforms, is justified in countries with national policies for facility-based use, but requires implementation research to assess register design and data flow within health information systems.

Kangaroo mother care: EN-BIRTH multi-country validation study.

BACKGROUND: Kangaroo mother care (KMC) reduces mortality among stable neonates ≤2000 g. Lack of data tracking coverage and quality of KMC in both surveys and routine information systems impedes scale-up. This paper evaluates KMC measurement as part of the Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study. METHODS: The EN-BIRTH observational mixed-methods study was conducted in five hospitals in Bangladesh, Nepal and Tanzania from 2017 to 2018. Clinical observers collected time-stamped data as gold standard for mother-baby pairs in KMC wards/corners. To assess accuracy, we compared routine register-recorded and women's exit survey-reported coverage to observed data, using different recommended denominator options (≤2000 g and ≤ 2499 g). We analysed gaps in quality of provision and experience of KMC. In the Tanzanian hospitals, we assessed daily skin-to-skin duration/dose and feeding frequency. Qualitative data were collected from health workers and data collectors regarding barriers and enablers to routine register design, filling and use. RESULTS: Among 840 mother-baby pairs, compared to observed 100% coverage, both exit-survey reported (99.9%) and register-recorded coverage (92.9%) were highly valid measures with high sensitivity. KMC specific registers outperformed general registers. Enablers to register recording included perceptions of data usefulness, while barriers included duplication of data elements and overburdened health workers. Gaps in KMC quality were identified for position components including wearing a hat. In Temeke Tanzania, 10.6% of babies received daily KMC skin-to-skin duration/dose of ≥20 h and a further 75.3% received 12-19 h. Regular feeding ≥8 times/day was observed for 36.5% babies in Temeke Tanzania and 14.6% in Muhimbili Tanzania. Cup-feeding was the predominant assisted feeding method. Family support during admission was variable, grandmothers co-provided KMC more often in Bangladesh. No facility arrangements for other family members were reported by 45% of women at exit survey. CONCLUSIONS: Routine hospital KMC register data have potential to track coverage from hospital KMC wards/corners. Women accurately reported KMC at exit survey and evaluation for population-based surveys could be considered. Measurement of content, quality and experience of KMC need consensus on definitions. Prioritising further KMC measurement research is important so that high quality data can be used to accelerate scale-up of high impact care for the most vulnerable.

Electronic data collection for multi-country, hospital-based, clinical observation of maternal and newborn care: EN-BIRTH study experiences.

BACKGROUND: Observation of care at birth is challenging with multiple, rapid and potentially concurrent events occurring for mother, newborn and placenta. Design of electronic data (E-data) collection needs to account for these challenges. The Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) was an observational study to assess measurement of indicators for priority maternal and newborn interventions and took place in five hospitals in Bangladesh, Nepal and Tanzania (July 2017-July 2018). E-data tools were required to capture individually-linked, timed observation of care, data extraction from hospital register-records or case-notes, and exit-survey data from women. METHODS: To evaluate this process for EN-BIRTH, we employed a framework organised around five steps for E-data design, data collection and implementation. Using this framework, a mixed methods evaluation synthesised evidence from study documentation, standard operating procedures, stakeholder meetings and design workshops. We undertook focus group discussions with EN-BIRTH researchers to explore experiences from the three different country teams (November-December 2019). Results were organised according to the five a priori steps. RESULTS: In accordance with the five-step framework, we found: 1) Selection of data collection approach and software: user-centred design principles were applied to meet the challenges for observation of rapid, concurrent events around the time of birth with time-stamping. 2) Design of data collection tools and programming: required extensive pilot testing of tools to be user-focused and to include in-built error messages and data quality alerts. 3) Recruitment and training of data collectors: standardised with an interactive training package including pre/post-course assessment. 4) Data collection, quality assurance, and management: real-time quality assessments with a tracking dashboard and double observation/data extraction for a 5% case subset, were incorporated as part of quality assurance. Internet-based synchronisation during data collection posed intermittent challenges. 5) Data management, cleaning and analysis: E-data collection was perceived to improve data quality and reduce time cleaning. CONCLUSIONS: The E-Data system, custom-built for EN-BIRTH, was valued by the site teams, particularly for time-stamped clinical observation of complex multiple simultaneous events at birth, without which the study objectives could not have been met. However before selection of a custom-built E-data tool, the development time, higher training and IT support needs, and connectivity challenges need to be considered against the proposed study or programme's purpose, and currently available E-data tool options.

Survey of women's report for 33 maternal and newborn indicators: EN-BIRTH multi-country validation study.

BACKGROUND: Population-based household surveys, notably the Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS), remain the main source of maternal and newborn health data for many low- and middle-income countries. As part of the Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study, this paper focuses on testing validity of measurement of maternal and newborn indicators around the time of birth (intrapartum and postnatal) in survey-report. METHODS: EN-BIRTH was an observational study testing the validity of measurement for selected maternal and newborn indicators in five secondary/tertiary hospitals in Bangladesh, Nepal and Tanzania, conducted from July 2017 to July 2018. We compared women's report at exit survey with the gold standard of direct observation or verification from clinical records for women with vaginal births. Population-level validity was assessed by validity ratios (survey-reported coverage: observer-assessed coverage). Individual-level accuracy was assessed by sensitivity, specificity and percent agreement. We tested indicators already in DHS/MICS as well as indicators with potential to be included in population-based surveys, notably the first validation for small and sick newborn care indicators. RESULTS: 33 maternal and newborn indicators were evaluated. Amongst nine indicators already present in DHS/MICS, validity ratios for baby dried or wiped, birthweight measured, low birthweight, and sex of baby (female) were between 0.90-1.10. Instrumental birth, skin-to-skin contact, and early initiation of breastfeeding were highly overestimated by survey-report (2.04-4.83) while umbilical cord care indicators were massively underestimated (0.14-0.22). Amongst 24 indicators not currently in DHS/MICS, two newborn contact indicators (kangaroo mother care 1.00, admission to neonatal unit 1.01) had high survey-reported coverage amongst admitted newborns and high sensitivity. The remaining indicators did not perform well and some had very high "don't know" responses. CONCLUSIONS: Our study revealed low validity for collecting many maternal and newborn indicators through an exit survey instrument, even with short recall periods among women with vaginal births. Household surveys are already at risk of overload, and some specific clinical care indicators do not perform well and may be under-powered. Given that approximately 80% of births worldwide occur in facilities, routine registers should also be explored to track coverage of key maternal and newborn health interventions, particularly for clinical care.

Counting on birth registration: mixed-methods research in two EN-BIRTH study hospitals in Tanzania.

BACKGROUND: Birth registration marks a child's right to identity and is the first step to establishing citizenship and access to services. At the population level, birth registration data can inform effective programming and planning. In Tanzania, almost two-thirds of births are in health facilities, yet only 26% of children under 5 years have their births registered. Our mixed-methods research explores the gap between hospital birth and birth registration in Dar es Salaam, Tanzania. METHODS: The study was conducted in the two Tanzanian hospital sites of the Every Newborn-Birth Indicators Research Tracking in Hospitals (EN-BIRTH) multi-country study (July 2017-2018). We described the business processes for birth notification and registration and collected quantitative data from women's exit surveys after giving birth (n = 8038). We conducted in-depth interviews (n = 21) to identify barriers and enablers to birth registration among four groups of participants: women who recently gave birth, women waiting for a birth certificate at Temeke Hospital, hospital employees, and stakeholders involved in the national birth registration process. We synthesized findings to identify opportunities to improve birth registration. RESULTS: Standard national birth registration procedures were followed at Muhimbili Hospital; families received birth notification and were advised to obtain a birth certificate from the Registration, Insolvency, and Trusteeship Agency (RITA) after 2 months, for a fee. A pilot programme to improve birth registration coverage included Temeke Hospital; hand-written birth certificates were issued free of charge on a return hospital visit after 42 days. Among 2500 women exit-surveyed at Muhimbili Hospital, 96.3% reported receiving a birth notification form and nearly half misunderstood this to be a birth certificate. Of the 5538 women interviewed at Temeke Hospital, 33.0% reported receiving any documentation confirming the birth of their child. In-depth interview respondents perceived birth registration to be important but considered both the standard and pilot processes in Tanzania complex, burdensome and costly to both families and health workers. CONCLUSION: Birth registration coverage in Tanzania could be improved by further streamlining between health facilities, where most babies are born, and the civil registry. Families and health workers need support to navigate processes to register every child.

Neonatal resuscitation: EN-BIRTH multi-country validation study.

BACKGROUND: Annually, 14 million newborns require stimulation to initiate breathing at birth and 6 million require bag-mask-ventilation (BMV). Many countries have invested in facility-based neonatal resuscitation equipment and training. However, there is no consistent tracking for neonatal resuscitation coverage. METHODS: The EN-BIRTH study, in five hospitals in Bangladesh, Nepal, and Tanzania (2017-2018), collected time-stamped data for care around birth, including neonatal resuscitation. Researchers surveyed women and extracted data from routine labour ward registers. To assess accuracy, we compared gold standard observed coverage to survey-reported and register-recorded coverage, using absolute difference, validity ratios, and individual-level validation metrics (sensitivity, specificity, percent agreement). We analysed two resuscitation numerators (stimulation, BMV) and three denominators (live births and fresh stillbirths, non-crying, non-breathing). We also examined timeliness of BMV. Qualitative data were collected from health workers and data collectors regarding barriers and enablers to routine recording of resuscitation. RESULTS: Among 22,752 observed births, 5330 (23.4%) babies did not cry and 3860 (17.0%) did not breathe in the first minute after birth. 16.2% (n = 3688) of babies were stimulated and 4.4% (n = 998) received BMV. Survey-report underestimated coverage of stimulation and BMV. Four of five labour ward registers captured resuscitation numerators. Stimulation had variable accuracy (sensitivity 7.5-40.8%, specificity 66.8-99.5%), BMV accuracy was higher (sensitivity 12.4-48.4%, specificity > 93%), with small absolute differences between observed and recorded BMV. Accuracy did not vary by denominator option. < 1% of BMV was initiated within 1 min of birth. Enablers to register recording included training and data use while barriers included register design, documentation burden, and time pressure. CONCLUSIONS: Population-based surveys are unlikely to be useful for measuring resuscitation coverage given low validity of exit-survey report. Routine labour ward registers have potential to accurately capture BMV as the numerator. Measuring the true denominator for clinical need is complex; newborns may require BMV if breathing ineffectively or experiencing apnoea after initial drying/stimulation or subsequently at any time. Further denominator research is required to evaluate non-crying as a potential alternative in the context of respectful care. Measuring quality gaps, notably timely provision of resuscitation, is crucial for programme improvement and impact, but unlikely to be feasible in routine systems, requiring audits and special studies.

Birthweight measurement processes and perceived value: qualitative research in one EN-BIRTH study hospital in Tanzania.

BACKGROUND: Globally an estimated 20.5 million liveborn babies are low birthweight (LBW) each year, weighing less than 2500 g. LBW babies have increased risk of mortality even beyond the neonatal period, with an ongoing risk of stunting and non-communicable diseases. LBW is a priority global health indicator. Now almost 80% of births are in facilities, yet birthweight data are lacking in most high-mortality burden countries and are of poor quality, notably with heaping especially on values ending in 00. We aimed to undertake qualitative research in a regional hospital in Dar es Salaam, Tanzania, observing birthweight weighing scales, exploring barriers and enablers to weighing at birth as well as perceived value of birthweight data to health workers, women and stakeholders. METHODS: Observations were undertaken on type of birthweight scale availability in hospital wards. In-depth semi-structured interviews (n = 21) were conducted with three groups: women in postnatal and kangaroo mother care wards, health workers involved in birthweight measurement and recording, and stakeholders involved in data aggregation in Temeke Hospital, Tanzania, a site in the EN-BIRTH study. An inductive thematic analysis was undertaken of translated interview transcripts. RESULTS: Of five wards that were expected to have scales, three had functional scales, and only one of the functional scales was digital. The labour ward weighed the most newborns using an analogue scale that was not consistently zeroed. Hospital birthweight data were aggregated monthly for reporting into the health management information system. Birthweight measurement was highly valued by all respondents, notably families and healthcare workers, and local use of data was considered an enabler. Perceived barriers to high quality birthweight data included: gaps in availability of precise weighing devices, adequate health workers and imprecise measurement practices. CONCLUSION: Birthweight measurement is valued by families and health workers. There are opportunities to close the gap between the percentage of babies born in facilities and the percentage accurately weighed at birth by providing accurate scales, improving skills training and increasing local use of data. More accurate birthweight data are vitally important for all babies and specifically to track progress in preventing and improving immediate and long-term care for low birthweight children.

Barriers and enablers to routine register data collection for newborns and mothers: EN-BIRTH multi-country validation study.

BACKGROUND: Policymakers need regular high-quality coverage data on care around the time of birth to accelerate progress for ending preventable maternal and newborn deaths and stillbirths. With increasing facility births, routine Health Management Information System (HMIS) data have potential to track coverage. Identifying barriers and enablers faced by frontline health workers recording HMIS source data in registers is important to improve data for use. METHODS: The EN-BIRTH study was a mixed-methods observational study in five hospitals in Bangladesh, Nepal and Tanzania to assess measurement validity for selected Every Newborn coverage indicators. We described data elements required in labour ward registers to track these indicators. To evaluate barriers and enablers for correct recording of data in registers, we designed three interview tools: a) semi-structured in-depth interview (IDI) guide b) semi-structured focus group discussion (FGD) guide, and c) checklist assessing care-to-documentation. We interviewed two groups of respondents (January 2018-March 2019): hospital nurse-midwives and doctors who fill ward registers after birth (n = 40 IDI and n = 5 FGD); and data collectors (n = 65). Qualitative data were analysed thematically by categorising pre-identified codes. Common emerging themes of barriers or enablers across all five hospitals were identified relating to three conceptual framework categories. RESULTS: Similar themes emerged as both barriers and enablers. First, register design was recognised as crucial, yet perceived as complex, and not always standardised for necessary data elements. Second, register filling was performed by over-stretched nurse-midwives with variable training, limited supervision, and availability of logistical resources. Documentation complexity across parallel documents was time-consuming and delayed because of low staff numbers. Complete data were valued more than correct data. Third, use of register data included clinical handover and monthly reporting, but little feedback was given from data users. CONCLUSION: Health workers invest major time recording register data for maternal and newborn core health indicators. Improving data quality requires standardised register designs streamlined to capture only necessary data elements. Consistent implementation processes are also needed. Two-way feedback between HMIS levels is critical to improve performance and accurately track progress towards agreed health goals.